Papers with uncertainty-aware LLMs
Representations of Fact, Fiction and Forecast in Large Language Models: Epistemics and Attitudes (2025.acl-long)
Copied to clipboard
| Challenge: | Existing models estimate and calibrate confidence of large language models with verbalized uncertainty, but they lack a careful examination of the linguistic knowledge of uncertainty encoded in the latent space of LLMs. |
| Approach: | They draw on typological frameworks of epistemic expressions to evaluate LLMs’ knowledge of epistenetic modality, using controlled stories. |
| Outcome: | The proposed models generate expressions matching the strength of evidence and are not robust in generating epistemic expressions. |